Performance analysis and comparison of PESQ and 3SQM in live 3G mobile networks
نویسندگان
چکیده
The ITU-T’s Perceptual Evaluation of Speech Quality (PESQ) is an intrusive objective assessment tool that has been widely used in telecommunications and IP networks. 3SQM is an ITU-T standard for single-sided non-intrusive quality measurement. The purpose of this paper is to investigate the accuracy of PESQ and 3SQM in evaluating voice quality over live 3G networks. We set up a testbed based on Asterisk to measure voice quality over 3G mobile networks. 192 voice samples from the ITU-T database were recorded via mobile phones during different times of the weekdays and the results of the objective measurements (in terms of PESQ and 3SQM) were analyzed. We further selected 30 samples (from 192 recorded ones) and carried out informal subjective tests (with 33 subjects). The correlation of the objective and subjective results was analyzed using a 3 order polynomial regression method. The results showed that overall PESQ (including PESQ-LQO) measures have a high correlation with subjective assessments whereas 3SQM measurements had a fair correlation. This suggests that PESQ is preferred to use for objective speech quality testing in live 3G networks when compared with 3SQM. We also found out two individual cases in which 3SQM provided better prediction results than PESQ. We notice that the quality degradation in these cases is mainly due to loss position. It indicates that PESQ still needs to improve its performance in cases such as different loss locations. 3SQM also showed useful in identifying quality problems in Individual tests. Therefore, we recommend a co-existence of both measures when investigating speech quality problems in 3G mobile networks.
منابع مشابه
PESQ and 3SQM measurement of voice quality over live 3G networks
The purpose of this paper is to investigate the accuracy of PESQ and 3SQM in predicting voice quality over live 3G networks. We set up an Asterisk-based testbed to measure voice quality over 3G mobile networks. 192 experiments with speech samples from the ITU-T database were recorded via 3G mobile phones and the results of the objective measurements were analyzed. We further selected 30 samples...
متن کاملThe Performance of the ITU-T P.862.1 Standard (PESQ-LQO) on AMR Live Networks
A comprehensive test has been performed in order to evaluate the PESQ performance on AMR live networks. The test was necessitated by the fact that the speech quality standard has not been tested and validated on AMR live networks yet. 1. Myth and reality about the AMR codec’s expected speech quality The operability of 3G networks is complex. It has been demonstrated that some estimated performa...
متن کاملAn efficient non-repudiation billing protocol in heterogeneous 3G-WLAN networks
The wireless communication with delivering variety of services to users is growing rapidly in recent years. The third generation of cellular networks (3G), and local wireless networks (WLAN) are the two widely used technologies in wireless networks. 3G networks have the capability of covering a vast area; while, WLAN networks provide higher transmission rates with less coverage. Since the two n...
متن کاملNetwork Investigation and Performance Analysis of ZigBee Technology using OPNET
Abstract- Communication has become inevitably part of our day to day activities, in academic, business, banking, and other sectors. It has therefore become so important to implement good and efficient communication system. A reference point according to this research is the wireless sensor networking (WSN) system, and most important thing in communication is to be free from interference, attenu...
متن کامل